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ABSTRACT * 

'." This guidie defines the objectives "and procedures of 
the United States Department of Education's Joint Dissemination 
Review Panel (JDRP), and the National Diffusion Network (NDN). The 
authors discuss the JDRP's methods of identifying successful 
educational programs and informing other schools nationwide about 
them. The major questions asked about, programs are covered here, as 
are the general procedures of considering the merits of programs 
submitted, including the clerical details of program submissions, 
activities during and after a JDRP review, and the handling of ( 
resubmitted proposals, A section of questions and answers addresses 
common concerns raised by, pro'gram developers aboutVttoe JDRP and the 
NDN (which provides funding* for disseminating information about 
JDRP-approved programs), A brief annotated bibliography lists related 
publications, films, and videotapes. (JW) 
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INTRODUCTION 



The purpose of this paper is to assist developers of educational programs, 
education officials, and evaluators' €o understand! the concepts and processes 
by which. the 'U. S. Department of Education identifies, recognizes, and 
disseminates high qual ity^educati onal products or (practices through the , 
Joint Dissemination Reviev? Panel and the National Diffusion Network, 
This paper provides detailed Jnformati on to these persons in order to * 
help^them understand and prepare for the revi ew .process* Mirch of this 
paper is based dto the actual experiences of individuals who have made 
presentations to the Joint Dissemination Review Panel. . « * 

Over the past years, the Federal Government provided fund£ for the development 
of many thousands of program^-under various education programs starting 
in the mj'd 1960s* Some of these programs were highly, successful-, but • 
-they were limited to the schools in which they were developed or 1 to other 
schools withio the $amfe State, Educators^outstde the State had little or . 
no oppportunit^ to learn about them or to make, use of thei r findings. 
Consequently, .the Federal investment in the programs, was never fully realized* 

Two needs became evident: „ 

1, 4 way to identify successful 'programs. < . - 

2. A way. to help schools learn about successful programs and » 
adopt the programs for their own use. ■ ^ 

The first of these needs was satisfied by creation- in 1972 of the Joint 
Dissemination Review Panel (JDRP). 

Often referred to as a "quality control mechanism", the JDRP is a group 
of U.S. Department of Education employees, experienced in education and 
evaluation, who carefully review evaluation based data, such as test 
scores, 'to determine whether programs should be"Tnade available to other 
schools. ' > 

Approval by the JDRP gives a program objective professional recogniti on V 
and the opportunity to compete for National Diffusion Network (NDN) 
dissemination funds. ' » ^ 

In NDN 1 s "first year, 32 locally developed programs were approved by the 
JDRP and were eligible to 'apply for NDN dissemination funds. r By December 
1983, 368 programs, developed in the local schools and other educational ^ 
agencies in 48 States apd the District of Columbia, had "passed" the 
JDRP and were eligible tQ apply for NDN funds. 

The second need— that of enabling schoolsto learn aboutand adopt JDRP- 
approved progftms--is fulfilled by the NDN. It disseminates information 
about JDRP-approved programs throughout the nation and sets up arrangements 
by which such programs way' be adopted in other schools. The NDN supports 
two kinds of project grants: Developer Demonstrators (DDs ) and State 
Facilitators (SFs). Developer Demonstrators provide information, training' 
and follow up services to schools interested- in adopting their programs, 



and'Faci litators 1 i nk\ up potential users ,wtt^^^P|1er Demonstrators. 
There is a State Facilitator in every State,^^g^gerto Rico t , ,and t he- 
Virgin' Islands. * 




By providiig funds -to both DDs and SFs, the -^BHB\ that -local ^schools 
or other agencies in any State can draw on quk'I^^M^ti'on, projects to 
solve their education problems. Let's now examlr^^f|3DRP. in detail. 

/ V # ■ \ 

What Is the Joint Diss-emi nation Review Panel? 

- ' — * i* ts 

The U.S. Department of Education 's chief review/grofp, the Joi nt ?Piss«minatton 
Review Panel (JDRP) Rigorously examines evidence f,i?||i education firograms, 
.products or practices that claim $i gni fi cant effe#$M?ness i n. attai ni ng their . 
goals. Any program or product that the Panel approWs has shown that* there 
is objective compelling evidence present to support the claims; The JDRP i 
also recommends national dissemination for all approved programs', products 
and practices . . . ■" ' ' t , \ . , ■ • ■ * < ° 

The JDRP is composed of 22 to 30 members from th.6 Department 's va.ri ous program 
offices, chosen for their ability to analyze evaluation-based data for evidende 
of effectiveness of educational programs. For'the purpose of review* seven' 
members of the" Panel who are present at the review meeting constitute a quorum. 
The members are concerned about several key questions,, such as: 

1. Has a specific positive/change occurred? What is the < ' > 
evidence of change? (Examples are: changes in test scores, the ■ \ / 
durability of. the change, the number of students affected by ' 

the change, the consistency bf positive change, cost savings to , 
the school, changes in attendance records)'. 

2. Can trie change' be attributed to the program rather, than to 

other causes, such as normal maturation, regular education programs, 
or other factors? * 

j' • , * . i . 

3. " Is the change great enough and observed oft^n enough; to be 

statistically significant? 

4. Is the change educationally significant? W^tls.the size of 
the change Ind what is the importance of the area in which 
the change has occurred? Is theicost reasonable, consideri ng the 
magnitude and area of change? ; 

5. Has the evidence supporting the program's claims been "gathered 
and interpreted correctly? 

6. Can the'projgram be used tn other locations with comparable 
impact? v " ■ \, ■ •» ' 



The Incision by the program office ^qffltlaW-to recfuest a JDRP review 

is completely "voluntary. • " % j • ■ . . . « 7 N ; • "■ - ) 

General Proteflures - ' '» ' ■? ; 



>A general summary* of the program's objectives/ claims, methodology, supporting 
' evidence. and interpretation, limitecj to lO pages, As c*l led a' "submi^taJ ■". 
An outline of the itern^ needed for tjie .submittal is .contained. -in the JDRP 1 f 
IDEABOOK . 1 ' ; > ; / "" • * ^ ■ / , 

'There are two procedures formakiri r g submittals the JDRP based on the. source 
of developmental^funding. F-irst, if the prpgra»(, product* or practi ce was 
developed with li'.S.' Department of^Education funds, the, local agency forwards^ . 
the JDRP submittal t}0 the'U. S. Department of Education program office thatf 
funded i, ts development. 2 This program office will pre-review the submittal^ 
and assist the local developer throughout the *K)RP process v It also serves 
as sponsor withih the Department for the submittals, 'For example, a program, 
office may "Kelp in t^ie preparation of the JDRP submittal, identify- sp&cific > 
resource^, and provide personal contact within the U.S. Department- of Education. 

Second, to forward a JORP submittal on a program that was developed with 
other Federal , St^ate and local government, or pri vate non-prof it organization 

. funds, requires another procedure.* The applicant sends the JDRP submittal 
to the DepartmenVs Division of National Dissemination Programs which administers 
the National Diffusi on Network. Personnel* from tt\at organization provide 
the agency submitting the JDRP submittal with technical assistance similar ■> 

. to that provided by the Departments other? program funding offices. 

• Agencies interested 'i h presenting a JDRP submittal should make vthei r .intentions 
known to the appropriate 1>.S. Department of Education program otfice as soon 
as. substantial^ evaluation data are avai lable 'for review. ■ Some program offices 

% require St^tte approval prior to* sendiqg the JDRP submittal to the U/S.* Department 
of Education. \ Thus, early contact witPK the. program office can save much; 
time, effort, and heartache. 



Prograjn Office Pre-reviews • 

^ ■ \ ~~ ** ■ ' 

Most program offices have pre-review committees x to examine the JDRP submittal. 

They review careful ly each submittal for strengths and weaknesses and initiate 
communication with the developer concerning it. < . , 

If ttfe ^re-review indicates that, the program i s ,not -ready for submission 
to the1>anel , it simply means that the committee believes the program ,is 
unlikely to be app'roved by the JDRP Tor one or more reasons. The submitter 
should then review the 'program retortfS and evaluati on data,*study the commi ttee's 
critique, and then make the decision to continue or discontinue the effort 
to submit to the JDRP. V \ \ 

|!See Appendix: Selected References. „' 

2 Because of consolidation of certain programs, the proigrani office that funded 
the development rtay no longer exist. In ttiat caie developers may send the 
JDRP submittal to the Division of National Dissemination Programs.' . 



Once the p're-review committee is satisfied with the submittal a memorandum- 
of transmittal is prepared and signed by the Assistant Secretary, of the. 
appropriate program office stating that the submittal has been pre-reviewed, 
is factua+Jy correct, and that the products or practices are socially 
fair'and apparently not ha^mfuV. This is the official notification of. ■ 
thejrogr'am's readi nes*~*or presentation-, to the JDRP by the prog.ram 
pfffe. When this memorandum is 'signed, it certifies to the JDRP that 
all stages of devel opment 'have been completed and thatthe submitted ;> 
program ,is orfejtfhat the program^ office believes is ready to be recognized 
and disseminated widely. * ,. 

What -ArtPW Of the Other Nitty-Gritty Detail s One Should Know? 

Fifteen copies of the submittal, the transmittal memorandum, and a brief 
(125-150 words) summary of the program are forwarded to the JDRP s txecutive 
Secretary, who then schedules the JORP meeting. ^ , k .* • , 

Panel members require a minimum. of five working d^ys to review the submittal ^ 
prior to a meeting. Typically, the Panel will consider three J«£""».l» / 
at each meeting, with each submittal receiving an hour orj>o of the Panel s , 
time. A Department of Education program office staff member represents the 
program,at the meeting. This staff member informs the' developer of the time 
and location of the meeting. Because of the variety of information neMed 
by the Panel members,' it is highly recommended that each program send the- 
local program director and program evaluator to accompany the program office 
staff member at the JDRP meeting. The costs for preparing the submittal, ^ 
travel, costs, etc. however, must come from the agency and developer making 
the submittal . ' ' 

Activities During and After JDRP Review 

The bulk of the time in a -Panel, review is spent on questions cfnd di scussi ons 
between the Panel, the agency staff,' and the developers for.clarif.1 cation 
and specific information. It should be' remembered r that -the Panel s 
questions are meant to bring out specific program evaluation details _ 
which are valuable in determi ni ng'program effectiveness and/or value to 
other educators interested in adopting the program. Implicit is tne \ 
goal of discovering the poslti've educational contributions of the submittal 
which may be present.' >.'..-• 

It is afways helpful for the persons representing the developer (i.e., local 
program^ director and/or evaluator) whose submittal will be reviewed to meet 
with the Department of Education program office's staff member prior to the 
JDRP meeting. This meeting peed not be long but some Vast-minute detai s _ 
can be clarified, such -as-discussing ways to respond to questions relating 
1 to the educational significance of the program or reporting on a meeting 
room change. The review .meetings- ,are held 'in Washington, fl.L. 

Panels convene in the morning, usually at about>:30 A.M G ^ a r ^ p f ..- 
- seven Panel members (including the/Chai rpersooT knd the' developers are seated 
at tables facing one another. The' Panel 's ExecuKve,'S ecretar y 15 a^o present 
to record the proceedings and to provide techni cal, assistance. 



The program office : staff member^ first introduce themselves, the^director 
of the project, anjd its evaluator. ' After introductions, a summary of the- 
submittal is made by the Panel's Chairperson 'to highlight thor program's goals 
and accomplishments and to make certain that the developer and the Panel 
both understand what exactly is being submitted. This summary- is also helpful 
t ; o. visitors who may attend ee meetings. After the summary, the Chairperson* 
opens the session for questions from Parte 1 members. The following illustrates 
the typejs of questions that might 'be asked: A member of the Panel might 
indicate 1;hat it.iVhard to pick up from, the submittal the nature of the 
program activities that wpyld'be exported. The panelist might ask: What 
did the teacher actually clo *in the. control classroom? What is the instructional 
materials 1 package that would be exported? These types of questions could 
be answered best.by the)progr v am director. The, director may spend about five 
.minutes summarizing the instructional procedures and products involved in , 
the program. ' 

Other Panel members may ask questions about the evaluation. The program 
evaluator usualjy^responds to these questions. - One type of jquestion may • 
be a clarification question. Other types of questions may involve the 
effectiveness of the program at different grade levels; whether the ; ■ ... ' 
program has ^achieved results that speak to the sustaining effects question 

;and .whether the effects might hoVd up with other not so simi lar student 
populations. - At the conclusion of this type of dialog, one of the Panelists 

suggest that the data presented are restricted basically to only one 
type of .student . population. Both program director arid evaluator may v 
wish to 'respond to this type of observation. It is sometimes helpful to 

'bring back-up data to the meeting which can be drawn upon to amplify 
data not described fully in the 1 0-page submittal . 

After -the FJ&nel members have had a chance to raise their quesions, the 
Chairperson may ask whether the sGore .di fferences between the treatment 
and comparison students were large enough to be Educationally significant. 

The program director may focus attention to a table .in the submittal containing 
the results from administering the primary data collection instrument'. The 
instrument, for example, may have 54 items and a mear} 'score difference between 
treatment and comparison students ort the post-test of 5.96 points. The 
Chairperson may ask the program evaluator to commment on what a mean v 
difference of 5.96 points truly means in terms of educational significance. 
The program evaluator might respond by pointing out that such a difference 
is ,meani ngful., given the fairly small amount of time the treatment .students 
were exposed to the materials and the, low cost of materials, or some 
other related types of valid explanation. This, type^bf dialog may continue 
for about an hour* or until each Panel member is convinced that. the 
program evidence has ,or fias not supported the claims. The presenters 
are free to raise questions themselves and/or to present 'any detai 1 they 
.may feel necessary to help support their claims. The Panel is receptive 
to colloquium-type discussion?. w When nq addi'tion^ul questions are forthcoming, 
the Chai rpersbn asks tfye Panel to vote." 



Panel Decisions 

At the beginning of the meeting, each Panelist is given a ballot w.ith the) 
program's name and JDRP assigned number job whi ch he or she votes "yes" or 
M no". Since each member's vote is eventually made public in the Panel's 
Official Minutes,. the w bal lot contains a place for the name of the Panel member, 
there is also space on , the ballot for comments. The comments may be very . 
helpful to the program director sjnce they point out areas of Panel concern 
that should be strengthened. After. the yoting is completed, the Chairperson 
counts -the ballots/ 

Pan6l members disqualify themselves from voting on submissions made -by programs 
in which they are di rectly invol ved, A simple majority is required for a 
Panel .decision that the evidence of effectiveness is compelling, A tie vote 
(rare)\is considered as being the same as a decision that the evidence is 
not convincing. The Panel 's decision is announced publicly by the Chairperson 
immedi ately^ol lowing the project review. % 



What' About Resubmissions? « 

Programs not favorably reviewed by the Panel may be resubmitted at any time. 
The Panel makes' every effort to specify weaknesses; it often makes recommendations 
which could result in a stronger resubmittal If the program director 
xan satisfactorily revise the submittal to meet the Panel 's concerns, 
.Jhen resubmission is advisable. .If not, do not resubmit. The Panel itself 
often recommends resubmission following comments and recommendati ons 'qn a 
program's defined deficiencies. Natur^'ly, approval of a resubmittal cannot 
be guaranteed. The Panel also welcomed resubmissions . of programs already ... 
approved but which now come with significant, improvements, additions or changes. 

Records of Panel Meetings f* 

the Minutes from each meeting are normally distributed to the. Panel members, 
developers, and other selected U.S. Department of Education personnel. Copies 
of the Minutes may be obtained from the JDRP 'Executive Secretary by other 
educators, evaluators, and administrators interested in the JDRP review process. 

What Happens After Approval? 

Once a program has been approved by the JDRP, several events take place. ; 
An official letter of congratulations and recognition of program approval " . 
is sent to the developers officials by the Executive Secretary Df^t he JDRP. 
A letter is also sent by the National' Diffusion Network (NDN) notifying the 
develotoer's officials that the program is now a part of tme NDN, the major 
dissemination arm of the U.S". Department of Education. The letter also contains . 
a "Welcome W&gon" kit which explains briefly the NDN and the role of the 
newly approved program as a Developer Demonstrator (DD). \ 



Questions and Answers: JDRP and NDN 



The following questions and answers represent common concerns/that individuals 
have raised since the JDRP ancj NDN began to work. While they are not all 
inclusive* they do represent the inquiries and experiences of others 
and roe/ be helpful. 

1/ How does one distinguish between a Stated validation and 
* the JDRP? Does JDRP approval result .i n automatic funding by 
the National .Diffusion Network? ^ 

4 Ans: State validation] and the JDRP are both involved in the 

review of evidence of effectiveness. The NDN concerns itself 
in the dissemination/diffusion of approved JDRP programs, 
products and practices. State validation procedure is a v 
function of the State and is not required by the JDRP/ 

Some States do require State validation before consrideri ng 
a JDRP submission. Other States permit a program to go 
directly to the U.S. Department of Education. Approval by 
the JDRP means that the Department of Educati or\ can acti vely 
disseminate the project. To recei ve Federal dissemination funds 
from the NDN as Developer Demonstrators, those projects that 
have been approved by the JDRP submit applications for grants 
px the NDN in periodic competitive funding cycles. , ^ 

* ' -< 

2. Does the Panel take into consideration the type of program 
represented in the submittal in light of the voids v that exist, • 
in the kinds of programs represented by the NDN? 

Ans : The JDRP wil 1 " consider any educational program recommended 
- through the pre-review proces's describ$tf previously. For- 
example, products and practices may cover areas from pre-school 
to adult education and management. The Secretary announces . 
annual funding priorities for the National Diffusion Network 
through notites which appear in ^t he Federal Register . At 
the time programs are approved by the JDRP, a copy of the 
most^ pecent priorities for NON funding will be included 
among the "Welcome Wagon 11 materials. k 

3. Is a program that is approved by the JDRP authorized to appear 
' in the NDN's catalog, Educational Programs That Work ? 

Ans : e> Yes. Only JDRP approved programs may be included in 
» ' , , the catalog. However, that does not automatically include 

NDN funding. Only about 30% of the programs that appear in 1 
Educational Programs That .Work receive NDN funding for 
dissemi nation in any one year. NDN funds, like other Department 
funds, are provided for in annual appropriations. The level 
*t of funds available for 'dissemination purposes may vary from 

year to year. I 



Oan one predict which- seven members of the Panel will shpw 4 . 
up f&r any given session? 

V 

Ans: No. The JDRP Executive Secretary knows the nature of 
the~submittals before calling together a quorum of seven 
Panelists. Membership of each Panel i^^differe'nt as their 
selection is basically rotaticfoal . Occasionally some members 
are selected on the basis of a particular knowledge. For 
example, a vocational or adult education professional may be 
on the Panel when these areas are b^i ng- considered. 

» * 
Is there some way of knowing who is more "stringent n arfH who 
is less "stringent" amSPhg the members of*the Panel and of being 
able to influence which $even members w4.ll make up your quorum 
ahead of time? . ' ■ \ 

Ans: Certain configurations of the seven Panelists 
tiave*' seemed to be more "stringent" than others. However, the 
Panel's structure and procedures preclude any outside influence ; 
being brought to bear on the composition of a particular quorum.* ' 
The professional atmosphere, expertness, and "mix" of the. quorum 
has shown its^affectiveness in assuri ng objecti ve decisions. 
Thus'the wordt and concept "stringent" should not really enter 
the situation; Panel members 1 deliberations are based oi\a strong 
sense of objectivity and professionalism. 

. s • 

If there is a resubmission, are you assured that the Panel 
will be reconstituted to include the same members who served 

when the original submittal was reviewed? 

* • . >* 

Ans: No. However, the program of f fee 'of fici al r , when introducing 
the program director at the second session of the Panel, is 
at liberty to say that this is the second time around. The 
official may wish to highlight the concerns expressed by the 
first Panel and explain how these concerns were satisfied. 
The secontl Panel, which may_ include a member of oi^two from* 
the initial group, will consider the earlier Panel's concerns 
4jT.the context of the resubmittal . In all cases, however, 
■"the Panel members are apprised of the earlier considerations 
and decision before the meeting so that the details may b(e 
. taken into' account for the new decision. , 

Do project staff have any i nfluence over & the\order in which 
the submittal is reviewed in a given session/of the Panel? 

Ans: Normally, a program is scheduled to appear in the order 
Tn - which the submittal has entered into the system. However, 
if the program is scheduled to appear last, and the program 
representatives have a plane flight, out of Washington, D.C. 
at 11:30 that morning, a request to the Panel will usually 
result in an adjustment being made. The Panel tries to be 
as flexible as possible. 
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How often does the Panel meet? 

•;> v - X 

Ans : There is no regular schedule. It 1 meets whenever as " * 
many as threesubmi tta I s have been received. Tffe Panel has been 
known to meet to review just one* submittal i»f others have not 
been presented for review within a reasonable period oPtime. 
The Panel meets about 2U to 25 times a year. 

Looking at 10 pages of written material and dat* tables, how 
do the Panelists know that what they are reading went on in the 
program? After all* the ODRP does not require State validation 
in which site-visits are made, and the Panel members do not. 
make visits themselves. 

• * *• 

Ans:, The Panelists rely on the program office transmittal , 
memo, the credibility of the project representatives in that, . 
session, and on the persuasi veness of the written . submittal . 
In addition, the Panel relies on -the pre-review process; within 
the Department to*ensure that the submittal is not oniy ; complete 
but is also an accurate reflection of the program. . 

Is it absolutely neceksary for a project to have government 
funding (State dr Federal ) before it can be considered by ^ 
the ODRP? ' ■ < 

Ans: No. Any -public or nonprofit private agency can make 
a submittal.' Only for-profit organizations are excluded. Many 
of the 368 JDRP approved programs, in the National Diffusion 
Network were developed with funds other /than from the U.S. 
Department of Education. For example, funds from the National 
Science Foundation, U. S. Department of Jfust/ce, Youth Development 
Act , and local educational agencies, have^rgen used to develop 
the exemplary programs. f 

• • • ' ' &\ 

Of what benefit is JDRP approval and possible NDN funding to 
an educational organization particularly, given the possible. 
"loss 11 of valuable staff persons^t? dissemination efforts? 

Ans: Some very good programs have never gone through the " 
process because of this yery issue. However, an educational 
group will receive national recognition for its efforts^and 
exemplary results and will receive numerous inquiries about' 
the JDRP apprqved program. This should be realized .in' advance, 
and an understanding reached between the developer, of the 
program and the group's administration. Since the school, 
system committed itself to the program l ahd enjoyed the bgnpfits 
of its results, a positive obligation to shaire this information 
with others exists. Traditionally, educators jjave always 
sought to find>.share or exchange exemplary programs and 
^rays to show others their development. The JDRP process and 
UffesfJDN provide the mea'ns for such sharing- to improve>ducation. 
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* 12. How does,an approved Vogranrback <j/xt of the NDN 1f It . X 
v becomes^ nundatetl wit If requests or its staff becomes committed 
— ^ along the lines-of .previous questions?/ 



Ans: Very s.impJe. The prorfram^ -officials do not nequest 
^funding from the NDNl Only they caVcfet ermine the extent of 
. their ^ssemyiation^ practices and capabilities', 

I^swthere an ^ap^eaV procedure if the; submittal is not 
i.\ppproved ; byvtj)e PanW? 

AnsT Nc* formal, appeals are necessary. The developer can 
come Jjack as -many times as it .wants' wi th new data and a resubmission, : 

■ * '% \ ■ . \ ; - ' ' ■ 

Does the Panel* use an object i ve rating scale, or does - 
it rely' on its* professional judgement abbut the evidence presented? 

■ . * .:, '. pr \ ■■■ - V , • > . - 
,Ans: The" latter. Panelists are asking the question: 1s the project 
Tffective, can 1t be refpli cated, does it help students, administrators, 

^rs, etc? " The Panel reaches a:* judgement based on the. w^ght ^ 
? thfe, evidence presented. If it approves a program, 1t 
i5 wing tljat'the program should be disseminated. ,It 1s up 
to the individual local u educHor to decide td'addpt 1t and adapt ; 
' it to the TScal settings ■ ^ • - 

1 5 1 "Does the JDRP expact a. developer to document that the 
'V ' program itself vfas the cause of .the principal intended outcomes? 

Ans: Yes. -The Panel requires that evidence be presented which v 

• ; .Indicates' Uh at it is the program, rather than other external * . V, 

factors* which is producing^he beneficial outcomes, 

H>1 Where can I go to get help in putting together niy submittal? 

* ' Ans: The references li steel in the appendix would be very \ 
useful., especially the JDRP IDEABOOK, and the Guidelines . 
In* addition, programs within the Secretary's list of priorities 1 t , > y 
' may recei ve direct assistance through professional evaluators & K 
' : •■. " available through the National Diffusion Network, Some other ! 
evaluators are available through indiW dual arrangements. , 
- The JDRP's Executive Secretary may also provide help* \ j > 

'-17. How soon can a developer* fiQd out if the submittal Has 
approved or disapproved for di'ssemjnaticrn? 

• ' v Ans: As soon as the ballots are* counted during^he Panel s review 

meeting. 1 The ChaiVpe&son will announce the. results of the Panel: ^ 
' . '< members 1 ^otes plus their recommendations to the developers. 




What are the chances for Panel approval? 



Ans: The answer to the question is really in three parts. 
First, submittajs do not go directly to the JDRP but to. a 
U.S. Department of Education program office pre-review groirp. 
This group provides comprehensive technical assistance to the 
agency which submitted the program. The data frorn one~pre-revi ew 1 
group show about 26% of the submittals received are forwarded 
to the JDRP. ^Second, the ODRP's figures show about 60 percent 
of the' submittals forwarded by the program office are approved 
at th^e. initial panel review' meeti ng. Third, about 80 percent 
of all resubmit tals are eventually approved. 



'( 





SELECTED REFERENCES 

U. S. Department of Education Joint Dissemination Review ! #>*S ! "- 
Panel . Pamphlet prepared by the Far West Laboratory for Educational 
Research and Development, San Francisco, California, (Contract : 
#300-77-041 5) (not dated )7 ' A brochure „which .provides an overview 
of the JDRP process and criteria for Submission. — 

U. S. Department of Education. Educational Programs That Work, 
Ninth Edition, 1983. ' ; ' 

This publication, produced initially by the Far West Laboratory,. % 
will probably be continued by some private, non-profit educational- 
service. Many agencies Reproduce the catalog in\ whole or in 
part. Another source (for information about NDN programs is 
the'Educational Resource Information Center (ERIC). The Center's 

complete address is in the succeeding reference. Additional 

information about NDN programs may be obtained by contacting: 

Marshall L. Schmitt, Seniot* Program Officer 
The National Diffusion Network 
Division of National Dissemination Programs 
U.S. Department of Education 

Room 613, Brown Building , ■ ■ 

400 Maryland Avenue; S.W. 
Washington, D.C. 20202 :) 
. (202) 653-7003 

U. S. Office of Education and the National Institute of 
Education\ IDEAB00K: The Joint Dissemination Review Panel, 
October 1 ~ ~* 

This publication is a result of a contract (number 

NIE 1A 0 7706) with- the RMC Research Corporation, Mountain View, 

California. It was written by G. Kasten Tallmadge. It illustrates 

the JDRP's six main concerns governing its decisions and 

many ways to gather convincing evidence of the effectiveness 

of educational innovations. It is the official guide for anyone 

planning evaluation in anticipation of future submission to 

the JDRP. This publication is available in the Educational 

Resources Information Center (ERIC). Inquiries concerning the - 

availabi lity -of ERIC microfiche should be sent directly to ERIC 

Document Reproduction Service (EDRS) Customer Service* P,0. 

Box 1901, Arlington, Virginia 22210. 

Joint Dissemination Review Panel (JDRP): Guide11nes t 
March 2, 1982 

An unpublished report usedin the U. S. Department of Education 
by persons working closely* with the National Diffusion Network 
and the Joint Dissemination Review Panel members and by 
those-prepani ng a submittal. It provides an explanation of 
why the Panel was established, the general procedures followed 



in actually preparing the 10-page submi ttal and the details 
on the criteria used for approval for dissemination. This - 
21-paj^e duplicated report can be obtained by writing to: 

* . J Seymour Rubak ^ * 
Executive Secretary 
- Joint Dissemination Review- Panel " 
U.S. Department of Education 
Room 615, Brown Building - 
400 Maryland Ave., S. W. 
Washington,. D.C. 20202 - 
(202) 653-7006 
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State Facilitators (see addresses in the catalog: Educational 
Programs That Work) . State Facilitators can identify evaluators 
i'n your area who are familiar with the JDRP process, identify 
resources that may be of help, and answer details about the 
functions of the various interrelated actions in the National 
Diffusion Network. f 



° NDN Video Tapes and films. , V 

1 . Joint Dissemination Review Panel: Selecting Educational ^ 
Programs That .Work, 1980 . This recent videotape/film production 
describes not only wfhat the Panel is, but by actual examples 

tells of its criteria, its quality control mechanism and procedures, 
and how it helps to recognize and initiate the transfer of successful 
education programs from national State, local government and 
private, non-profit sourcps elsewhere in the nation. Through, 
actual interviews and excerpts from "a Panel meeting, the production 
helps to fully tell and show the critical role the Panel plays 
in American education. Its connection with the National Diffusion. -r 
Network Is clearly and well -portrayed and detailed. Potential 
viewers and users of this two part .38 1/2 minute tape are those 
who either are now planning to submit a program to the Panel 
ar will in the future; professionals in teacher education 
and administration; teachers; educational evaluators;f educational 
change agents, etc. »' v 

2. National Diffusion Network: Art Overview, 1980 . Thiss37 
minute, two part program, graphically and objecti vely 
looks at what the Nationa/T Diffusion Network is, what it does, 
how it does it, who does" what, and with what successes. It 
is a comprehensive view of the Network's elements - the 'l[)eveloper 
Demonstrators" («DDs), its "State Facilitators" (SFs), and 

technical assistance-contractors. Their role and relationship 
ihe NDN and .the Joint Dissemination Review Panel is also 
Clearly presented. Educational professionals at all levels, 
as well as private, non-profit groups working in education are 
prime viewers of this, videotape/film. It is quite valuable 
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- * ■ , also to -administrators apd funding boards who are charged with 

making dec\si ons about the cost effecti ve. educati onal improvements 

3, National Diffusion Network ; Transferri ng Educational Prbgrams - 
That -Work , ^980 , This videotape/film shows in an almost 
'documentary *way exactly what happens when ^a school^ interested 
' in a program approved by the Joint Dissemination. Review 
Panel, goes about adopting this program through the National 
Diffusion Network, .Needs, problems, resources, false starts 
and the step by step successes to eventual adoption are all 0 
dealt with openly.- The 28*1/2 minute production is in two 
parts for easier presentation. It is valuable for awareness 
and training sessions,, and is of interest to educational 
administrators, parents, grou^teachers , educational change 
. agents, and school board members. 

Information concerning availability" of 'these _ video tapes/films can be 
obtained by writing to : 

National Audio Visual Center 
General Service Administration (GSA) 
Washington, D.C. '20409 
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